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© Communication system using trellis coded GAM. 

© Coded modulation schemes based on codes (or OPSK modulation are dir ectly. 

... . #^ m in« t«>iii<t coded QAM to provide a pract cal coding structure that is both etliciem in 

codfno i used In an encoder (Fig. 2). an N-bil QAM conslel.af.on pattern (80) is divided .n.o lour subsets, each 

remaining bits. The metrics we "~I r * te th6 QPSK code word One ol a plurality of the conditional determ.na- 
UonTissetectedln ST ZT^J^l £ se.ec.ed condition, determination is combined 
vT.he recovefe^ bit to provide a decoded output that is further decoded using a symbo. error correct.ng 

algorithm such as a Reed-Solomon code (36). 
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BACKGROUND OF THE INVENTION 

Tho present invention relates to trellis coded quadrature amplitude modulation (QAM) and more 

particularly to a practical method lor coding QAM transmission. 

s Digital data tor example digitized video lor use in broadcasting h.gh de.,n,.,on elev sior (HDTV) 
signals can be transmitted over terrestrial VHF or UHF analog channels lor communication to end users. 
aIToo channels deLer corrupted and .ranslormed versions ol their input waveforms. Corruption ol the 
wave^tm usually statistical, may be additive and/or multiplicative, because o. possible backgrour* , ermal 
noise impulse noise, and lades. Translocations perlormed by the channel are Irequency translauon. 
to nonlinear or harmonic distortion and time dispersion. ....... , . ,„, „„, m ni« a 

in order to communicate digital data via an analog channel, the data ,s modulated ^. USI "9- '° r . 
,orm o. pulse amplitude modu.a.ion (PAM). Typically, quadrature amplitude modulanon ^« 
increase the amount ol data that can be transmitted within an avertable channel bandwidth QAM ,s a lorm 
ol PAM in which a plurality ol bits ol information are transmitted together .n a pattern relerred to as a 
,s -constellation" that can contain, lor example, sixteen or thirty-two pomts. riMemined bv a 

In pulse amplitude modulation, each signal is a pulse whose amph.ude level .s de«erm,ned lb* ■• 
\ . transmld symbol. In 16-bit QAM. symbol amplitudes o. -3. -1. 1 and 3 in each quadrature channel are 

\ . typically used. Bandwidth elliciency in digital communication systems ,s def, ned as the numbe r o. 

transmitted bits per second per unit o. bandwidth, i.e.. the ratio ol he data «ie to the 
20 Modulation systems with high bandwidth elliciency are employed in applications that have h,gh data rates 
and small bandwidth occupancy requirements. OAM provides bandwidth ell.cien. modula t,on_ 

On the other hand, modulation schemes such as quadrature phase sh.lt keying (OPSK). common y 
lound in satellite transmission systems, are well established and understood. In OPSK^a ir»o.« . s«rnple 
constellation pattern than that provided in QAM results. In particular. OPSK systems use a 
„ pattern having only lour symbols that are typically positioned 90 degrees apart from each other ,n phase, 
but have the same amplilude. Thus, the lour symbols are equally spaced about a circle. 

OPSK modulation- is suitable lor power limited systems where bandwidth limitations are not a ma,or 
concern. OAM modulation, on the other hand, is advantageous in bandwidth limited systems, where power 
requirements do not present a major problem. Therefore. OPSK has been the system ol cho.ee m satellite 
30 communication systems, whereas QAM is preferred in terrestrial and cable systems. As a consequence o, 
the popularity ol OPSK. integrated circuits that realize trellis coded OPSK modulation are readily avaHable 

3,>d Trellis coded e m'odulation (TCM) has evolved as a combined coding and modulation technique lor digital 
transmission over band limited channels. It allows the achievement ol »9™" £ *' 9» « 

« conventional uncoded multilevel modulation, such as QAM. without comprom.sing bandwidlh elliaency. 
TCM schemes utilize redundant nonbinary modulation in combination with a linite-s.ale encoder which 
governs the selection ol modulation signals to generate coded signal sequences. In .the reiver J henoisy 
signals are decoded by a soil-decision maximum likelihood sequence decoder. Such schemes can improve 
the robustness o. digital transmission against additive noise by 3-6 dB o, more, compared to conventional 

« uncoded modulation. These gains are obtained without bandwidth expansion or reduction ol the ellec ve 
information rate as required by other known error correction schemes. The .er m -trems « ^ 
these schemes can be described by a state-transition (trellis) diagram similar to the t "****0™» ol 
binary convolution^ codes. The difference is that TCM extends the princ.ples ol convolut.onal codmg to 
nonbinary modulation with signal sets ol arbitrary size. •«„- r „„i 

<s The availability ol components lor implementing trellis coded OPSK modulation » a sign. lean, 
advantage in designing low cost communication systems lor a P p.icaUons. such as satellite commun^ns 
wherein QPSK techniques excel. However, such components have not been o. ass.s.ance ,n fomenting 
other coded transmission systems, such as those in which QAM is preferred. comDO nents 
Fo, applications that are bolh power limited and band lirmted and require to* cos ^' components 

so (particularly low cos. data decoders,, conventional QAM systems have not been feas be due to he 
complexity and relatively high cos. ol .he required encoder and decoder c.rcu,.s In lacl. .. « typ-cal .o 
imolemenl QAM trellis encoders and decoders in expensive custom integrated crcui. chips. 

One power I mi.ed and band limited application in which a low cos. solution ,s necessary lor 
communing digital data is .he digital communication ol compressed high de«on ^elev,s,on s, na £ 

55 Systems lor UansmiUing compressed HDTV signals have dala ra.e requ.rernen s _on me 

megabits per second (Mbps). bandwidto occupancy requirements on the order ol 5-6 MHz (the bandwidlh 
o. a conven.iona. National Television System Committee (NTSC) television 

reliability requirement (i.e.. a very small bit error ,a.e>. The data ra.e requirement arises Irom the need 
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provide a high quality compressed television picture. The bandwidth constraint is a consequence of the U.S. 
Federal Communications Commission requirement that HDTV signals occupy existing 6 MHz television 
channels, and must coexist with the current broadcast NTSC signals. This combination of data rate and 
bandwidth occupancy requires a modulation system thai has high bandwidth elliciency. Indeed, the ratio ol 
data rate to bandwidth must be on the order ol 3 or 4. This means that modulation systems such as QPSK. 
having a bandwidth efficiency without coding of two. are unsuitable. A more bandwidth efficient modulation, 
such as QAM is required. However, as noted above. QAM systems have been too expensive to implement 
for high volume consumer applications. 

• The requirement for a very high data reliability in the HDTV application results from the fact thai highly 
compressed source material fi e., the compressed video) is intolerant ol channel, errors. The natural 
redundancy of the signal has been removed in order to obtain a concise description of the intrinsic value of 
the data. For example, for a system to transmit at 15 Mbps for a twenty-lour hour period, with less than one 
bit error, requires the bit error rate (BER) of the system to be less than one error in 10 12 transmitted bits. 

Data reliability requirements are often met in practice via the use of a concatenated coding approach, 
which is a divide and concur approach to problem solving. In such a coding framework, two codes are 
employed. An "inner" modulation code cteans up the channel and delivers a modest symbol error rate to 
an "outer" decoder. The inner code is usually a coded modulation that can be effectively decoded using 
"soft decisions" (i.e.. finely quantized channel data). A known approach is to use a convolution^ or trellis 
code as the inner code with some form of the "Viterbi algorithm" as a trellis decoder. The outer code is 
most often a t-error-correcting, "Reed-Solomon" code. Such Reed-Solomon coding systems, that operate in 
the data rate range required for communicating HDTV data, are widely available and have been imple- 
mented in the integrated circuits ol several vendors. The outer decoder removes the vast majority of 
symbol errors that have eluded the inner decoder in such a way that the final output error rale is extremely 
small. 

A more detailed explanation ol concatenated coding schemes can be lound in G. C. Clark. Jr. and J. B. 
Cain. "Error-Correction Coding tor Digital Communications". Plenum Press. New York. 1981; and S. Lin and 
D. J. Costello. Jr.. "Error Control Coding: Fundamentals and Applications". Prentice-Hall. Englewood Cliffs, 
New Jersey. 1983. Trellis coding is discussed extensively in G. Ungerboeck, "Channel Coding with 
Multilevel/Phase Signals". IEEE Transactions on Information Theory . Vol. IT-28. No. 1. pp. 55-67. January 
1982; G. Ungerboeck, "Trellis-Coded Modulation with Redundant Signal Sets -- Part I: Introduction. - Part 
II: State of the Art", IEEE Communications Magazine . Vol. 25. No. 2. pp. 5-21. February 1987; and A. R. 
Caulderbank and N. J. A. Sloane. "New Trellis Codes Based on Lattices and Cosels". IEEE Transactions on 
Information Theory. Vol. IT-33. No. 2. pp. 177-195. March 1987. The Viterbi algorithm is explained in G. D. 
Forney. Jr.. "The Viterbi Algorithm". Proceedings of the IEEE . Vol. 61. No. 3. March 1973. Reed-Sotomon 
coding systems are discussed in the Clark. Jr. et al and Lin et al articles cited above. 

The error rate performance at the output of the inner, modulation code in concatenated coded systems 
is highly dependent on signal-to-noise ratio (SNR). Some codes perform better, providing a lower error rale 
al a low SNR while others perform better at a high SNR. This means that Ihe optimization of the modulation 
code for concatenated and nonconcatenaled coding systems can lead to different solutions, depending on 
the specified SNR range. 

It would be advantageous to provide a data modulation system with high bandwidth efficiency and low 
power requirements. Such a system should provide a high data rate, with minimal bandwidth occupancy, 
and very high data reliability. The complexity of a receiver for use with such a system should be minimized, 
to provide low cost in volume production. Optimally, the system should be able to be implemented using 
readily available components with as little customization as possible. 

The present invention provides a modulation system having the aforementioned advantages. In 
particular, the method and apparatus ol the present invention expand a trellis coded QPSK system to a 
trellis coded QAM system, without sacrificing data reliability. 

SUMMARY OF THE INVENTION 

In accordance with the present invention, a method is provided tor communicating digital data using 
QAM transmission. An n-bit QAM constellation pattern is divided into lour subsets. Each subset includes 
N/4 symbol points of the constellation pattern. A different two-bit codeword is assigned to each of the lour 
subsets. A symbol to be transmitted is encoded by processing a first bit ol the symbol with a rate 1/2 
binary convolutional encoding algorithm to provide the two-bit codeword assigned to the subset in which the 
symbol resides in the constellation pattern. The two-bit codeword is mapped with the remaining bits ol the 
symbol to provide a modulation function. The remaining bits correlate the symbol with one of the N/4 
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symbol points inc.uded in .he subset defined by the codeword. A carrier is modulated with the modulation 
(unction lor transmission on a communication channel. modulation 
In an illustrated embodiment, the two-bit codeword forms the least s,gnil,cant b,ts ol the mod "' a, '°" 
.unc^n a^ dennes the columns o. a matrix o. coordinates o. the constetiation patter. The ^ 
.orm the most significant bits ol the modulation lunction and determine the s.ze o. the 
In a concatenated approach, information bits are firs, encoded into symbols us,ng. lor , examp e . . I ymb° 
error correcting code, such as a Reed-Solomon code. These encoded symbols are then passed to a trellis 
pnrnriflr which oroduces the desired modulation for a earner. 

6 C M r the rdu^on .unction is transmitted, it is recovered a, a receiver. The ^covered motion 
lunction is pruned to provide a set ol metrics corresponding to the subsets and to provide a pWly o 
bvTe Trap esenting dil.erent condition^ determinations ol a signal point identified by the rema.mng b. s The 
m u c te used ?n a" a^orithm (such as the V.terbi a.gori.hm) lor decoding a rate 1/2 binary convo u ona 
cTe o recover the lirs bit. The recovered first bit is encoded using a rate 1/2 binary convolutional 
Z d! g a^r! to recreate the codeword. One o. the conditiona. dete— on - 
response to the recreated codeword. The selected byte is then comb,ned with the recovered first 

P '°th?pre e Lm1nvS also provides apparatus lor encoding digi.a. data lor QAM transmission. The 
encode nO des mtans lor parsing a symbol to be transmitted into a firs, bit £- 
bit Means are provided lor encoding the first bit wilh a rate 1/2 binary convolution^ encoding agonlhrr to 
orovTde a .w^Tc^word that defines one ol lour subsets ol an N-bit QAM constellation pattern, each 
X, inc ud^^NM symbol points ol the constellation pattern. The codeword is mapped w th the .remaining 
Ws to Provide a modulation function. The remaining bits correlate the symbol with one ol the N/4 s mbo. 
po n ts SdVdtnThe subset defined by the codeword. Means are provided lo, modulating a earner w, h the 
mliationtction lor transmission on a communication channel. Mo* ^'^.^^ £ 
encoding inlorma.ion bits using an error correcting algon.hm to prov,de the symbol that ,s parsed by 

'"l^^ated embodiment, the codeword lorms the leas, significant 

and defines the columns ol a matrix ol coordinates ol said constellation pattern. The remam ng bits lorm the 
ml significant bits o. the modulation lunction and determine the size o. the constellation pattern. The 

i encoding means can use a trellis coding algorithm. H pmn H u iates a 

rwodino aooaratus is also provided in accordance with the invention. A receiver demodulates a 
race* e c Ze, ^ o recove an N-bH QAM modulation lunction in which a two-bit codeword identities one ol a 
p uZ ol QAM constellation subsets and the remaining (N-2) bit portion represents a signal pom. w, h,n 
st^one subset Means are provided lo, pruning .he recovered modulation lunction .o provide a e. ol 

5 m^rics corresponding .o said subsets and .o provide a plurality o. (N-2) bi. subgroups represem.nga 
S o ^ on^na?de,ermina.ions ol .he signa, point identified by the (N-2) bi. portion The metrics r 
used in an atoorilhm lor decoding a rate 1/2 binary convolution^ code to recover a first bit. The recovered 

(unction and defines the columns ol a matrix of constellat.on coord.nates. w.th the selected subgroup 

receiver can comprise a high definition television carrier signal. 
BRIEF DESCRIPTION OF THE DRAWINGS 

" Figure 1 is a block diagram ol a QAM transmission system emp.oying conca.ena.ee I coding; 
F gu e 2 s a block diagram o. a trellis encoder in accordance with the presen invention 
F gure 3 s a btock diagram ol a .re.lis decoder in accordance with the presen, invention. 
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Figure 4 is an illustration of a QAM constellation pattern divided into subsets in accordance with the 
present invention; 

Figure 5 is a diagram defining the labeling of subsets in the constellation pattern ot Figure 4; 

Figure 6 is a diagram illustrating the labeling of constellation points in the constellation pattern of Figure 

4; and 

Figure 7 is a graph illustrating the performance of a concatenated coding scheme in accordance with the 
present invention as compared to a prior art coded QAM scheme. 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 illustrates a concatenated coding system for communicating QAM data. Digital information to 
be transmitted is input to a symbol error correcting coder 12, such as a Reed-Solomon encoder, via an 
input terminal 10. Encoder 12 converts the information into a codeword 14. comprising a plurality of 
successive n-bit symbols 16. While an outer convolulional code could be used for. encoder 12, the bursty 
nature of the errors in a transmission system, the fact that only hard quantized data is available, and the 
desirability of a high rate code make a Reed-Solomon code, whose symbols, are formed from n-bit 
segments ot the binary stream, a good choice lor the outer code. Since the performance of a Reed- 
Solomon code only depends on the number of symbol errors in the block, such a code is undisturbed by 
burst errors within an n-bit symbol. However, the concatenated system performance is severely degraded 
by long bursts of symbol errors: Therefore, an interteaver 18 is provided at the output of Reed- Solomon 
encoder 12. to interleave the symbols {as opposed to individual bits) between coding operations. The intent 
of the interleaving is to break up the bursts of symbol errors. 

The interleaved symbols are input to a QAM trellis coder 20. In accordance with the present invention, 
coder 20 incorporates a QPSK code into a trellis coded QAM modulation system, as described in greater 
detail below. 

The output of coder 20 comprises symbols representative of coordinates in the real (I) and imaginary 
(Q) planes of a QAM constellation pattern. One such constellation point 22 is symbolically illustrated in 
Figure 1. The symbols are transmitted by a conventional transmitter 24 via a communication channel 26. 
The communication channel introduces various distortions and delays that corrupt the signal before it is 
received by a receiver 28. As a result, the coordinate values embodied in the received symbols will not 
correlate exactly with the transmitted coordinate values, such that a received point 30 will end up on the 
constellation pattern in a different location than the actual transmitted point 22. In order to determine the 
correct location for the received point, and thereby obtain the data as actually transmitted, the received data 
(7. Q) is input to a QAM trellis decoder 32 that uses a soft-decision convolulional decoding algorithm to 
recover the transmitted information. A decoder in accordance with the present invention is described in 
greater detail below. 

The decoded output from decoder 32 is input to a deinterleaver 34 that reverses the effects of 
interleaver 18 discussed above. The deinterleaved data is input lo a Reed-Solomon decoder 36 for recovery 
of the original information bits. 

In the present invention, a QPSK code is incorporated into the trellis coded QAM modulation system to 
provide a high data rate, bandwidth efficient system with a moderate bit error rate in low SNR regions of 
operation. In order to achieve this result, the codewords of the QPSK code and the "uncoded" bits which 
together define a symbol are uniquely assigned to a QAM constellation. In addition, the received signal is 
decoded by a combination ol a sofl-decision decoder with techniques for deciding which constellation 
points the "uncoded" bits refer to. 

Figure 2 illustrates an encoder in accordance with the present invention. Data bits (e.g.. from interleaver 
18 • Figure 1) are input to a conventional parsing circuit 42 via an input terminal 40. An N-1 bit symbol to 
be transmitted is parsed into a first bit that is output on line 46 to a convolulional encoder 48. The 
remaining N-2 "uncoded" bits are output on line 44 to a 2 N -QAM mapper 50. Convolutions encoder 48 
employs a rate 1/2. 64-state convolutional code, in which the generators are 171 and 133 in octal. The two 
bits output from encoder 48 and the N-2 uncoded bits (N bits total) are presented to the 2 N -QAM mapper 
for use as labels to map the N-bil symbol to a specific constellation point on a QAM constellation. The two 
"coded" bits output from convolulional encoder 48 are actually QPSK codewords, and are used to select a 
constellation subset. The uncoded bits are used lo select a specilic signal point within the constellation 
subset from the QAM constellation. 

For purposes of QAM transmission (encoding), the codewords of the GPSk code and the remaining 
uncoded bits must be assigned to the QAM constellation. For this purpose, one must describe a labeling of 
QAM constellation points by a modulation function. MOD(m)iR 2 , 
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MOD:{0, 1} M -~ R 2 . 

The mapping described below has the iollowing desirable features: (1) the consequences of the 90* phase 
ambiguity ol QAM is imposed on the QPSK codewords while the uncoded bits are invariant to the > a"b.gu>ty 
(i e ihe 90* phase ambiguity can be dealt with in the same manner as the QPSK system) and (2) the most 
significant digits control the constellation size (i.e. a nested scheme (or 16/32/64 - QAM). 

Consider the labeling described by the following matrix, for 16-QAM (m* = m, = ™ 
m* = M 3 = m ? = 0): 



0) (and QPSK. m 5 



MOD(r7>5 m 4 /7b mz my mo) 










00 


0 1 


1 1 


1 0 


0 0 0 0 


{ +1. + 1 


-1.+ 


1 -1.-1 


+1.-1 \ 


00 0 1 


+ 1,-3 


+3.+ 


1 -1. + 3 


-3. - 1 


0 0 11 


-3.-3 


+3. - 


3 +3. + 3 


-3. +3 


00 10 


^ -3. + 1 


-1. - 


3 +3.-1 


+1. + 3 ; 



for 32-QAM (m> « 0) add: 





MODf/T* rru nh m, ny,) 






25 




00 


0 1 


1 1 


1 0 




0 100 


f +5. - 3 


+3. + 5 


-5, + 3 


-3,-5\ 




0 101 


+ 1. + 5 


-5. + 1 


-1.-5 


+5.-1 


30 


0 111 


+5,+ 1 


-1.+5 


-5.-1 


+1.-5 




0 110 


^ -3, + 5 


-5,-3 


+3,-5 


+5, + 3 / 




(or 64 -QAM add: 










35 


MOD(mb m 4 rTb nh'my rrh) 








/7I5 /TL| /T^j ^ 


00 


0 1 


1 1 


1 0 




1100 


t +5. + 5 


-5, + 5 


-5.-5 


+5, - 5 ^ 


40 


110 1 


+5.-7 


+7. + 5 


-5. + 7 


-7,-5 




1111 


-7.-7 


+7.-7 


+7. + 7 


-7. + 7 




1110 


-7, + 5 


-5,-7 


+7,-5 


+5, + 7 


45 


1000 


-3.-7 


+7,-3 


+3, + 7 


-7, + 3 




100 1 


-7,+ 1 


-1.-7 


+7, - 1 


+ 1, + 7 




1011 


+1.-7 


+7, + 1 


-1. + 7 


-7,-1 


50 


10 10 


\-7.-Z 


+3.-7 


+7. + 3 


-3. + 7 J 



The outpuls ol Ihe QPSK encoder lorm the least significant bits (LSBs) m.rn,. ol the 
and select the co.umn ol the matrix. The most significant bits (MSBs) de.erm.ne the c*«~ 
no uncoded bits (n» = m, = m, = m, = 0). OPSK is generated. Wi.h 2 uncoded I bus. m,m>. IB-GAM » 
Generated With 3 uncoded bits, m.m,m,. 32-QAM is generated. Wi.h « uncoded Ms. m.m.m,m, 64- 
QAM ^enell Furthermore, the el.ec. o. rotating .he OAM cons.etla.ion by 90Ms to rotate the columns 
ol the matrix. 
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00-* 01 - 11 — 10 - 00; 

which leaves the rows invariant This means the labeling of the uncoded bits is unaffected by 0 " . 90 ' . 
180' and 270* rotations. The handling of the 90* phase ambiguity at the, receiver (decoder) is left solely to 
Ihe QPSK encoder. Whatever method is used for resolving the ambiguity at the QPSK receiver can be 
directly incorporated into the QAM system using this labeling. For example, differential encoding of QPSK 
could be used if the QPSK code is itself rotationally invariant. 

• The labeling of a 16-QAM and 32-QAM constellation pattern in accordance with the present invention is 
illustrated in diagrammatic form in Figure 4. The constellation patterns, generally designated 80, correspond 
to the 16-QAM and 32-QAM matrices given above. In particular, for the 16-QAM example, the 16 
constellation points are provided in a dashed box 90. The constellation points are divided into four subsets 
indicated by tokens 82, 84. 86. 88 as shown in Figure 5. Each subset contains four constellation points. 
Thus, for subset 82 designated by an open circle, four points 82a, 82b. 82c. and 82d are provided within 
box 90. The subset itself is defined by the two coded bits (QPSK bits) mO. ml as indicated at 92 of Figure 
6. For the 16-QAM implementation, the specific point within each subset is identified by the "uncoded" bits 
m2. m3 as indicated at 94 in Figure 6. Thus, 82c is defined as the 00 subset and the 01 1 point wilhin lhat 
subset. Each remaining constellation point, such as points 84a. 86a. and 88a. are similarly identified. 

For a 32-bit QAM implementation, the additional 16 points oulside of dashed box 90 are also included. 
These points are labeled similarly, with all three bits m2. m3, m4 designated at 94 in Figure 6 being used. It 
will be appreciated that the labeling set forth can be expanded to higher levels of QAM. 

A feature of the labeling scheme used in accordance with the present invention, as indicated in Figure 
5, is that the Hamming weight of each QPSK symbol equals the Euclidian weight divided by a factor x. 
where x corresponds to the (minimum distance) 2 between constellation points. In the present example, the 
constellation points illustrated in Figure 4 are provided at QAM levels of 1, -1, 3. -3. 5. -5 in each of the 
quadrature channels, and therefore the minimum distance between constellation points is two. such that the 
Hamming weight is equal to the Euclidian weight divided by 4. 

Figure 3 illustrates an implementation of a QAM trellis decoder in accordance with the present 
invention. The received symbol data is input to a pruner 62 via an input terminal 60. Pruner 62 processes 
the recovered modulation function to provide a set ol metrics corresponding to the subsets defined by the 
QPSK codewords, and to provide a plurality of (N-2) bit subgroups representing a plurality ol conditional 
determinations of the signal point identified by the transmitted uncoded bits. In particular, four metrics are 
output on line 66 to a rate 1/2 64-state Viterbi decoder 68. Four sets of (N-2) bil conditional determinations 
are output on line 64. 

Pruner 62 can comprise a memory device, such as a programmable read only memory (PROM), that 
stores a loox-up table containing precomputed sets of metrics and conditional determinations for different 
sets of input values (I. Q). The (T, Q) values are used to address the PROM to output the corresponding 
stored metrics and determinations. This allows a very high speed pruning operation. The Viterbi decoder 
uses an accumulated history of the metrics received from the pruner to decode Ihe QPSK codewords. 

The Viterbi decoder 68 illustrated in Figure 3 can be a conventional rate 1/2 decoder that is available for 
use with conventional QPSK coding schemes. Thus, in order to implement Ihe decoder of the present 
invention, a custom Viterbi decoder is not required to decode the trellis codes. 

Consider the process of signal detection when a soft-decision QPSK decoder is incorporated in a 
system employing the previously described QAM modulator. First, in hard-decision detection of QPSK or 
QAM signals, the received signal. 

y h = K + W h . 

is quantized, where the signal, x k . belongs to the QPSK or QAM constellation (i.e.. in the^range of MOD(rn)) 
and w h is the noise. The quantization function produces an estimate of both the signal. x h . and the data m. 
according to the relation, * = MOD(m). For maximum likelihood detection (ML), the log-likelihood function. 
- log(p(y k | MOD(m))). is minimized over the possible messages, m * (0. l) M .where p(y* | x„) is Ihe 
conditional probability of receiving y„ given that x k is transmitted. For random messages. ML detection 
minimizes the probability of error. The most common method of quantization is nearest (Euclidean) 
neighbor detection, which satisfies 
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||* - >*|| 2 - m min ||n - MOD(m)|| 2 

where Hi 2 is the Euclidean distance squared (i.e.. the sum of the squares). In the case of additive Gaussian 

noise, nearest neighbor detection is ML. . L ^ ^ . , K h™h 0 , ior 

In coded QPSK and QAM systems, sort decision information should be provided to the decoder for 
effective decoding of the codeword. This soft-decision information is often described as a symbol metr.c; 
this metric indicates the quality of deciding a particular symbol. x h = MOD(m). was sent when y h is 
received. For nearest neighbor decoding, the metric of choice is: 

metric^; m) = By h - MOD(m)R 

tn practice, the metric Itself is quantized for purposes of implementation. In QPSK for example, for each 
possible message. m„ mo , {0. 1}'. the nearest neighbor metric !y> - MOD(m, , mo)B 2 « the ML metric lor 

additive Gaussian noise. , . 

In trellis coded QAM modulalion. based on a soil decision decodable QPSK code, lour symbol mrtncs 
must be supplied to the decoder, as well as lour conditional hard decisions. For nearest neighbor detection. 

for each choice of mi . mo ( {0. 1 } 2 

met/ic(y*; nh, n\>) = win \\y k - MOD(m w _,, • ••, n^, m,, /7fc)|| 2 ; 

the conditional hard decision's correspond to the choice of m M , m* that obtain the rtrimm. Tte 

process of determining the symbol metrics and conditional hard decisions is known as pruning. In l eHis 
coded QAM. the uncoded bits appear as "parallel- branches of the trellis, and the computet,™ of he 
symbol metrics and conditional hard decisions acl to prune all but the single best branch from the set of 

Para Nole 6d lhat pruning is easily described in terms of the QAM modulation matrix presented above. The 
pruning operation simply involves quantizing the received symbol. Y h . for each column of the matrix. The 
conditional hard decision is then the best choice lor each column and the metric corresponds to the quality 

o( that decision. . » rt ik q 

Once the pruning operation has been completed, the soft dec.s.on information is presented to he 
decoder of the QPSK code. (During this time, the conditional hard decisions are stored waiting for the 
QPSK decisions.) The QPSK decoder, using the soft decision information, decodes the QPSK mlormahon 

(i.e.. the m,. m 0 s). The remaining information (i.e.. the m N , m 2 s) is then decided .n a well known 

manner using the decoded QPSK information and the previously stored conditional 1 ^rd decisions 

Note that if the QPSK decoder is ML. (tor QPSK modulalion) then the prun.ng/QPSK decoding method 
, described is also ML. For example, if the QPSK code is a binary convolutions code with nearest neighbor 
(i.e., Viterbi) decoding, then the QAM trellis decoding algorithm is also nearest neighbor (i.e.. f.nds the 
closest codeword to the received sequence). ,!™h 0 , 
in the embodiment illustrated in Figure 3. the metrics output from prune, 62 are decoded by decoder 
68 to recover a single bit that corresponds to the single bit output on hne 46 ,n the encode, ot Figure 2 
, This bit is re-encoded with a rate 1/2 64-state convolution! encoder 70 Odenfcal to encoder 48 « £ 
to recreate the two-bit QPSK codeword. The recreated codeword is used to select one of "r (N^ brt 
suboroups output Irom the pruner. alter the subgroups have been delayed by a delay buffer 72 for an 
™uTo Ume equal to the de.ay introduced by decoder 68. The selected (N-2, bit 
combined with the recovered single bit (rom decoder 68 in a serializer 76. to prov.de a trelks decoded 

' "'"As noted in connection with Rgure 1. the decoded output may exhibit a modest symbol error ^rate that 
must be .urther improved by an outer decoder. Thus. ^P~» - * ™ £M 



Se^r 34 'ZTtZZZZ decoder 36 (Figure „ is used to recover the origin, 

'"'Teaimam o. the oulput biterror rate, with a given input symbol error rate, lor a t error-correcti^ 
Reed^lomon code can be'easi.y computed. An (extended, "-^Sol-on c^e over the hn.te eld w,t M 
= 2' has parameters. (n« k. I), where the blocklenglh n„SqM, the d.mens.on. k - n BS - 21. and the 
erro^correctrn capability" t errors. For a memoryless. symbol error channe. wi,h input symbol error rate. 
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Pi«. the output symbol error rate is bounded by: 

n RS / n Rs\ "RS-* 
Pit^Cl/n,,) E + -Vi/(l-p ln ) P in ! min(i + t, n„) . 

Then, the output bit error rate is approximated by the formula: 

Also, if the / bit symbols of the Reed-Solomon coda are composed of smaller, n bit symbols (e.g., the 
decoded symbols of a trellis coded QAM modulation) then the input error rate is: 

is ph, - 1 - 0 - pud) 1 " 

where p^od is the n bit symbol error rate. To guarantee a "memoryless" channel when coded modulation is 
employed, the use of interleaving is required. 

Figure 7 illustrates the performance of two concatenated systems, one employing conventional rate 2/3 

20 trellis codes and decoding, and the other using the rate 1/2 QPSK implementation of trellis coded QAM in 
accordance with the present invention. The graph of Figure 7 plots Reed-Solomon block error rate against 
the carrier-to-noise ratio (CNR) in the received signal. A block error (or codeword error) occurs if one or 
more m-btt symbols are in error in the block. Curve 100 represents the performance of a concatenated 
Reed-Solomon trellis coded 16-QAM system in accordance with the present invention, using a rate 1/2, 64- 

25 state decoder. Curve 104 represents the performance ol a similar system using trellis coded 32-QAM. 
Curve 102 represents the performance of a conventional trellis coded 16-QAM, rate 2/3, 16-state decoder. 
Curve 106 represents the performance of a conventional trellis coded 32-QAM rate 2/3. -16-state decoder. 

The curves of Figure 7 were determined by using trellis coding simulation results to estimate the 
probability of an m-bil Reed-Solomon symbol being in error, pRs, ym , and then calculating the probability of a 

30 Reed-Solomon block error in accordance with the following formula: 



L ft) 

where L is the Reed-Solomon block length (number of m-bit symbols per block) and t is the number of 

Reed-Solomon symbol errors that can be corrected per block. The 16-QAM system uses 116. 8-bit symbols 
40 per block, and the 32-QAM system uses 155, 8-bit symbols per block. Both Reed-Solomon codes can 

correct up to five, 8-bit Reed-Solomon symbols per block. 

The curves in Figure 7 show that il it is desired or necessary to operate the system below a certain 

CNR. then the trellis coding approach of the present invention, represented by curves 100. 104, is clearly 

the correct choice. Even at higher CNRs. however, the trellis coding approach of the present invention may 
45 still be a belter choice, because the trellis decoder apparatus can be produced in a more cost effective 

manner using a conventional QPSK Viterbi decoder chip. 

It should now be appreciated thai the present invention provides a practical system for digital 

transmission of power and band limited signals, such as compressed high definition television signals. A 

coded modulation scheme based on codes tor QPSK modulation is directly incorporated into a QAM based 
so modulation system, forming trellis coded QAM. This provides an easily imptementable structure that is both 

efficient in bandwidth and data reliability. 

Although the invention has been described in connection with specific embodiments thereof, those 

skilled In the art will appreciate thai numerous adaptations and modifications may be made thereto without 

departing from the spirit and scope of the invenlion as set forth in the claims. 

55 

Claims 

1. A method for communicating digital data using QAM transmission comprising the steps of: 
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dividing an N-bil QAM constellation pattern into lour subsets, each subset including N/4 symbol 
points ol said constellation partem: 

assigning a different two-bit codeword to each of said lour subsets; . 

encodino a symbol to be transmitted by processing a first bit of said symbol with a rale ia binary 
convltoal encoding algorithm to provide the two-bit codeword assigned to the subset ,n wh,ch sa,d 
symbol resides in said constellation pattern; H ..i a r.nn 

mapping said two-bit codeword with the remaining bits of said symbol to prov.de a modu anon 
funcL wherein said remaining bits correlate said symbol with one of the N/4 symbol pomts .nc.uded 
in the subset defined by said codeword; and . 

modulating a carrier with said modulation (unction for transm.ss.on on a commun.cat.on channel. 

2. A method in accordance with claim 1 wherein: .... ^ M ,™ ih d 

said two-bit codeword forms the least significant bits ol said modulation lunct.on and del.nes the 
columns ol a matrix of coordinates ol said constellation pattern; and 

Taid ?ema?ning bits form the most significant bits of said modulation function and determine the 
size of said constellation pattern. 

3. A method in accordance with claim 1 or 2 comprising the further step of encoding information bits 
using an error correcting encoding algorithm to provide said symbol. 

4. A method in accordance with claim 3 wherein said convolution^ encoding step uses a trellis coding 
algorithm. 

5. A method in accordance, with any ol the preceding claims comprising the furlher steps ol: 

receiving said carrier at a receiver; 

demodulating the received carrier at said receiver to recover said modulat.on (unction. 

pruning the recovered modulation function to provide a set ol metrics cor respond. ng to sa.d 
subsets and to provide a plurality of bytes representing different conditional determ.nal.ons of a s.gnal 
point identified by the remaining bits; ra ^, ar „:h 

using said metrics in an algorithm for decoding a rate 1/2 binary convolution^ code to recover sa.d 

f,rSt encoding the recovered first bit using a rale 1/2 binary convolution^ encoding algorithm to recreate 

"^s^eclTng one of said conditional determination bytes in response to said recreated codeword; and 
combining said selected byte with the recovered first bit to provide a decoded output. 

6. A method in accordance with claim 5 comprising the further steps of: 

encoding information bits using an error correcting encoding algorithm to prov.de sa.d symbol to be 

transmitted: and . 
further decoding said output using a symbol error correcting decoding algorithm. 

7. A method in accordance with claim 5 or 6 wherein said algorithm lor- decoding is the Viterbi algorithm. 

8. Apparatus lor encoding digital data lor QAM transmission comprising: 

: means lor parsing a symbol to be transmitted into a first bit and al least one remaning bit 

means «or encod^g said first bit with a rate 1/2 binary conventional encoding algonthm to provide 
a two bU codeword IhaTdefines one ol lour subsets o. an N-bit QAM constellation pattern, each subset 
including N/4 symbol points ol said constellation pattern: „„,:„„ 
means lor mapping said codeword with said remaining bits to provide a modulation luncuon 
, wherein said remaining bits correlate said symbol with one ol the N/4 symbo. pomts mcluded in the 
subset defined by said codeword; and „^. nn 
means lor modulating a carrier with said modulation function lor transmission on a communication 

channel. 

Apparatus in accordance with claim 8 further comprising an outer encoder for encoding information bits 
using an error correcting encoding algorithm to provide said symbol. 
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10. Apparatus in accordance with claim 8 or 9 wherein: 
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said codeword forms the least significant bits of said modulation function and defines the columns 
of a matrix of coordinates of said constellation pattern; and 

said remaining bits form the most significant bits ol said modulation function and determine the 
size of said constellation pattern. 

s 

11. Apparatus in accordance with one of claims 8 to 10 wherein said encoding means use a tretlis coding 
algorithm. 

Apparatus for decoding OAM symbol data comprising: 

means for demodulating a received carrier to recover an N-bit QAM modulation function in which a 
two-bit codeword identifies one of a plurality of QAM constellation subsets and the remaining (N-2) bit 
portion represents a signal point within said one subset; 

means for pruning the recovered modulation function to provide a set of metrics corresponding to 
said subsets and to provide a plurality of (N-2) bit subgroups representing a plurality of conditional 
determinations of the signal point identified by the (N-2) bit portion; 

decoder means for using said metrics in an algorithm for decoding a rate 1/2 binary convolutional 
code to recover a first bit; 

means for encoding the recovered first bit using a rate 1/2 binary convolutional encoding algorithm 
to recreate said codeword; 

means for selecting one of said plurality of (N-2) bit subgroups in response to said recreated 
codeword; and 

means for combining the selected subgroup with the recovered first bit to provide a decoded 
output. 

25 13. Apparatus in accordance with claim 12 wherein said codeword comprises the least significant bits in 
said modulation function and defines a column of a matrix of constellation coordinates, with the 
selected subgroup forming the most significant bits and defining a row of said matrix. 

Apparatus in accordance with claim 12 or 13 wherein said pruning means quantize the recovered N-bit 
modulation function for each column of a matrix of constellation coordinates and said conditional 
determinations comprise a best choice for each of said columns with the set of metrics identifying the 
quality of each choice. 

15. Apparatus in accordance with one of claims 12 to 14 wherein said decoding means comprise a decoder 
as that uses a soft decision algorithm for decoding convolutional codes. 

16. Apparatus in accordance with one of claims 12 to 15 further comprising: 

an outer decoder for decoding said output using a symbol error correcting algorithm, 
whereby the combination of said decoder means and said outer decoder torm a concatenated 
40 decoder. 

17. A concatenated decoder in accordance with one of claims 12 to 16 wherein said decoding algorithm 
comprises the Viterbi algorithm. 

is 18. A concatenated decoder in accordance with claim 16 or 17 wherein said symbol error correcting 
algorithm comprises a Reed-Solomon code. 

19. A concatenated decoder in accordance with one of claims 12 to 18 wherein said carrier is an HDTV 
carrier signal. 

so 
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